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ABSTRACT 


Global and local image information is crucial for accurate segmentation of 
images with intensity inhomogeneity valuable minute details and multiple 
objects with various intensities. We propose a region-based active contour 
model which is able to utilize together local and global image information. 
The major contribution of this paper is to expand the LIF model which is 
includes only local image information to a local and global model. 
The introduction of a new local and global signed pressure force function 
enables the extraction of accurate local and global image information and 
extracts multiple objects with several intensities. Several tests performed on 
some synthetic and real images indicate that our model is effective as well as 
less sensitivity to the initial contour location and less time compared with the 
related works. 
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1, INTRODUCTION 

It 1s quite normal that the crucial step needed for many vision applications by computer and image 
processing is Segmentation of images. Within this framework, this paper aims at developing models dealing 
with problems of detecting objects (segmenting images) characterized by intensity inhomogeneity which 
represents an intensity variation in the regions of images and makes segmentation difficult. Divergent 
techniques have been proposed [1-2] and currently, active contour model (ACM) [1, 3-6] is the most method 
used in image processing in view of the quality and of the results it offers. In fact, the basis of the ACM is 
evolving a curve under some constraints from a given image to match the shape of the desired objects, by 
minimizing energy functional. Theoretically, ACMs are classified intotwo main_ categories: 
edge-based [1, 3, 4, 6, 7-10] and region-based [5, 11-17]. 

The primary work of Edge-based models is the detection of contours which approximate 
discontinuities of the gray level, color, texture. So they use the gradient image by evolving the curve to reach 
the edges of interest object. Within this type, geodesic active contour (GAC) [4] is one of the most accurate 
techniques. GAC meets difficulty when dealing with the objects having blurred or discrete boundaries and it 
hardly segments the object corrupted by noise [18], although it has been effectively applied for images with 
high variation in gradient at the contours of the objects. 

Unlike edge-based models that look for dissimilarities, the region-based models rather look for 
similarity. These approaches provide a map of closed areas. They utilize image statistics inside and outside 
the curve to control the evolution. One of the famous region-based models 1s the [5] which is a simplified 
Mumford-Shah model [12]. The C-V model utilizes the global property of homogeneous regions. Thus, it has 


Journal homepage: http://iaescore.com/journals/index.php/ijeecs 


248 Oj ISSN: 2502-4752 


good segmentation result for the objects with weak or discrete contours but often fails when the intensity 
inhomogeneity is present in image [19]. 

Some works using local image property are cited such as presented by Li et al in [19-20] and Wang 
et al in [22]. Li et al introduces a local binary fitting (LBF) energy by using local mean intensity property 
instead of global ones. Furthermore, Wang et al illustrates Local image intensities by local Gaussian 
distributions (LGD). Therefore, this two models gives more robustness when the inhomogeneity dominates 
the images. However, they can be falling in local minimums and in addition the result is more dependent on 
the contour initialization. 

In [23] a local image fitting model is presented for segmenting images with no uniform intensity 
where the authors define the local image property on the differences between the fitting image [20-21] and 
the original one. Additionally, Gaussian filtering 1s introduced for regularizing the level-set function. 
It ensures a uniform evolution equation, and eliminates the requirement of resetting the curve evaluation, 
which is very computationally expensive. 

Other hand, a region-based active contour methods are formulated in [24-25, 28] by utilizing a 
signed pressure force (SPF) function based on the two global and local intensity means respectively. The first 
model is used in order to handle non homogeneity. However, the second model is effective for noisy images. 
The Gaussian kernel 1s introduced in their equation of level set to stabilize it. Thus, it doesn’t require 
re-initialization at each step. 

Our contribution is to present a new a local (ACM) inspired from [23]. Our method is not based 
only on the local property of the fitted image but we will also consider the global one. Furthermore, 
we multiply the difference local and global fitted images expressions to formulate the energy functional. 
After minimizing this functional, we replace the difference local and global fitted images with the local and 
global signed pressure force (SPF) functions in the variational level set equation. Both local and global (SPF) 
functions are used for detecting regions with intensity inhomogeneous and ones homogenous respectively. 
For reducing the computational time and accelerate the convergence of the evolution equation, we apply the 
Gaussian kernel to regularize the contour at each iteration. 


2. RELATED WORK 
2.1. Chan-Vese (CV) Model 
The energy of CV model is given as follow: 


FV (Ce,ey)=4, — fli(x)-e, PdxtA, — JU(x)-05 I? dx tv IC 
outsidd C ) inside C ) (1) 


Where outside (C) and inside (C) represents the regions outside and inside the curve C, respectively. 
cl and c2 designate two constants that approximate the image intensities in outside(C) and inside (C), 
respectively. “are fixed constants. The third term is the length of the curve. After minimizing (1) by 
using the descent gradient [27], the (1) 1s expressed as the zero level set evolution curve and the 


corresponding level set equation is : 
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In practice, the Heaviside function and Dirac function are smoothed by: 


1x20 
H(x)= 
aes (4) 
5(x)= Hx) 
dx (5) 


Because the CV model uses the global property so they give to CV model a good performance when 
segmenting images with weak edges and noise. However it fails when the inhomogeneity strongly exists in 
the image since it doesnt incorporate local property. 


2.2. Local Binary Fitted (LBF) Model 

The LBF model which is proposed by Li et al. in [20-21] utilizes two spatially varying fitting 
functions f1(x) and f2(x) to approximate the local intensities on the two sides of the contour. And the image 
fitting energy function was defined as follows: 


Ee SAN To) Ge) H( Wy ))dy Jdx 


dy ff | K(4-y (y= fol x)? (1 AM y )) dy Ide 

QQ (6) 
where (Al, 42) are positive fixed parameters. Ko 1s a Gaussian kernel with standard deviation o, and fl and f2 
are two smooth functions that approximate the local image intensities inside and outside curve C, 
respectively. 


Minimizing the energy functional ELBF with respect to o, the gradient descent flow is defined 
as follows: 


og 
Fy PMA — Age )+¥8,(8) (7) 


Where el and e2 are defined as: 
e(x)=[Ko(x-y)I(y)- F(x) d 
l eel ek a | y 
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Functions fl and f2 are the local intensity means inside and outside curve C, which are computed in 
a local region: 
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The LBF method could properly segment a homogeneous object from the inhomogeneous 


background. Since it uses local property, it is easy to be attrapped in minima local. So, it strongly dependent 
on initial contour position [27]. 


2.3. Local Image Fitted (LIF) Model 
The LIF model proposed by Zhang et al. [23] utilizes the local image property to form an energy 
function, which is written as: 
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The energy function is based on the difference between the local fitting image and the original 
image [23]. The local fitting image 1s defined as follows: 


I”! =m, Hb )+m,(1- Hg) ‘is 
Where m1 and m2 are expressed as: 

m, = mean(I €((x € Alp( x) >0)Aw,(x))) 

my = mean( I €((x € Ald( x) <0) Aw, (x ))) 42) 


Wk is a window function. By minimize the energy functional with respect to level set function 0, we 
can obtain: 


a =6,()(1-I" )\(m,-m, ) 
Ot (13) 


where 6.9) is the regularized Dirac (5). 


3. PROPOSED METHOD 
In order to segment intensity inhomogeneous images, the following energy functional 
is defined: 


Eorcrr = Exori( 9)+ LL, (9)+VA,( 9) (14) 


u > 0 and v > 0 are fixed parameters. Lg() and Ag(o) are length and area terms, respectively [7] : 


L,(b)= | 9(1)6,(6 IV olds, 
2 (15) 


A,($)= | g(1)H,(-9 idx, 
= (16) 
The energy function Ag(@) is introduced to speed up the curve evolution. It is the area of the region 


a ( yd ae %y) | = } Ag(@) can be viewed as the weighted area of 29 
In (16), g(1) is a positive monotonously decreasing edge indicator function ranging in [0, 1]: 


1)= 
1+|VK, *]| (17) 
ELGFI is defined according to the following reformulation of (10): 
a (1x) — Tin (x) (M2) — Lom (x)))dx 
* (18) 


In (18), let ILFI(x) be a local fitted image and IGFI(x) a global fitted image, using a level set 9, 
which are defined as: 
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Tor(xX)=C\M, +c,M), (20) 
Where fl and f2 are local intensity means and cland c2are global intensity means of the given 
image as defined in (9) and (3), respectively. 
M)= HP) aynqM2=C- 9) , where H(0) is the regularized Heaviside (4). 
As follow, we present a hybrid model to deal the intensity inhomogeneity problem firstly and then 


ensure its convergence in computing time very reduced. ELGF in (18) is minimized with respect to 9, 
By using the calculus of variations and steepest gradient descent [26]: 
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{cl, c2} and {fl, f2} are global and local intensity means defined in (3) and (9), respectively. 
The terms (/(*)~ firi(*))(el—c2 Jand (I(x )~ Ter *)F1— F2) in (21) are replaced by local and global 
signed pressure force (SPF) functions because the above equation 1s not stable around object boundaries and 


doesn’t give a good segmentation when the contours of inhomogeneous objects and the background are 
inseparable. Thus it results an unstable contour. The evolution equation is proposed as follow: 


0 
og _ (A, LeprlC, — Cy )+A,G spr fi — fo )) 
a (22) 


where the proposed local and global SPF functions which normalize the values to [-1,1] are 
defined as: 


I(x )—Typ7( x) 








xX) #O 
Lspr = max(|I( x )—Ipp,( x) ) 
0, I(x)=0, (23) 
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Gspp =4 max(|I(x)—Ige( x) ) 
0, I(x) =0, (24) 


By using the calculus of variations and steepest gradient descent, the solution of Eg,_LGFI from (14) 
using (15) and (16) 1s: 


+6 A Lspr( Cy — C2 )+A,Leprl fi — fo ) + 
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VA (5) 


The two scaling parameters Aland i2in (22) and (25) are used to tune the model for different types 
of images. The SPF functions defined in (24) and (25) are used to normalize the local and global image 
differences in the range [-1, 1] inside and outside the region of interest. The new SPF functions proposed in 
this work are based on both global and local intensity-based fitted images. 

Finally, the different steps of the proposed algorithm are as follows: 

1. Initialization of the level sets function © to be a binary function as follows: 


o( x,t =0)=40, x €0DQ, 
, xED -Q 
pP 0 (26) 
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where p 1s a positive constant, % is the inner region of the initial contour, £2 is the image domain and 029 
refers to the initial contour. 


2. Compute the edge indicator function g(I) using (17) 

3. Compute the local intensity means, f1, f2, and the global means, cl, c2, using (9) and (3), respectively. 

4. Calculate LSPF(U) and GSPF()) using (23) and (24), respectively. 

5. Solve the partial differential equation (PDE) of © using (25). 

6. Regularize the level-set function @ at time t by applying a Gaussian kernel Gy, 1.e. 0 = Gy*o, where y is 
the standard deviation of the regularizing Gaussian kernel. 

7. Check whether the regularized level-set function is stationary. If not, iterate from step (3). 

4. RESULTS AND ANALYSIS 


In this section, we apply and compare the proposed model with the different models using both 


synthetic and real images. All models are implemented using Matlab 7.0 on Windows 7; on 2.3 GHz Intel 
core 15 PC with 6GB of RAM. Unless otherwise specified, the parameters are described in Table 1. 


Figure 1 shows the segmentation results of the related methods and the proposed method on a 


synthetic image with two objects with blurred boundaries. From the first row, we can observe that all models 
can satisfactorily segment the two objects. Furthermore, the iterations and CPU time are listed in Table 2. 


The second row of Figure 1 demonstrates the segmentation results. As shown, they cannot detect the 


boundaries of the two objects after the same number of iterations mentioned in Table 2. Figure 2 shows a 
segmentation result comparison with the related methods of image with intensity inhomogeneity. 





Table 1. Description of the Parameters used in the Study 


Parameters Description 
Pp To initialize the level set function, o >0 isa constant (LBF: p =1,:LIF: o =2 and our model : p =1). 
oor y Scale parameter in Gaussian kernel (LBF: o =4, LIF: o =3, vy =land our model: o=3, v =0.5). 
Ail ho Weighting parameters (C-V, LBF: AJ = 42 =1 and Our model 4; =/, 22 =5). 
At Time step (LBF, At = 0.1; C-V, LIF and our model: At = 1). 
é The parameter of smoothed Heaviside function (LBF, LIF and our model: ¢ = 1.5). 
VU Area and length terms are regularization parameters of curve C (C-V: w=0.2, v=0, LBF:u=0.0/and our model u=1, 
v=0.25). 





(a) (b) 


Figure 1. Segmentation results on a synthetic image: (a) initial contour, Segmentation result by: (b) the LIF 
model, (c) the LBF model, (d) the CV model and (e) the proposed model 


Table 2. Iterations and CPU Time Needed by the Methods Compared when Segmenting the Image 


in Figure 1 
Methods iterations CPU time (s) 
The LIF model 40 2.48 
The LBF model 50 3.29 
The CV model 100 4.15 
The proposed model 8 1.81 
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(a) (b) (c) (d) (e) 
Figure 2. Comparison of segmentation results using synthetic image with intensity inhomogeneity (a) initial 
contour. Segmentation result by: (b) the CV model. (c) the LBF model. (d) the LIF model. 
(e) the proposed model 





It can be seen that the methods using global region information (CV) cannot segment well when an 
image has an intensity inhomogeneous region in it. The segmentation results with LBF are shown inthe third 
column. This method is only able to properly segment the first image, while the segmentation results are not 
acceptable for the other images. The fourth column shows the segmentation results using LIF. This method is 
able to properly segment the first image. As for the second and the third image, the contour is not quite 
smooth along the boundary of the object. Although it is able to segment the object in the fourth image, 
some undesirable contour is stuck in the background. The last column shows the segmentation results using 
the proposed method, which is able to properly segment all images. 

Figure 3 shows the experiments conducted with synthetic images with different types of region 
properties, we used an image with a single homogeneous object and then progressively changed its intensity 
distribution to a point at which it is even difficult to manually segment it, thus making the object 
inhomogeneous. The first row shows the five input images with the initial contour, whereas the segmentation 
results are shown using C-V [5] in the second row, LBF [13, 21] in the third row, LIF [23] in the fourth row 
and our model in the last row, respectively. Visual inspection clearly shows that the C-V method cannot 
segment well when an image has an intensity inhomogeneous region in it and both the proposed method and 
LBF provide the best segmentation results. LIF also yields acceptable segmentation results, although the final 
contour in this method is not quite smooth along the object boundaries. For all the examples in Figure 3, 
the parameters of all methods were kept constant. 

In Figure 4, we apply all the tested methods to synthetic images with different initial contour. 
The first row shows various initial contours, the second, the third rows and the last row show the 
segmentation results by the LBF model, the LIF model and the proposed model, respectively. From some 
initial contours, as in column 1, the LBF model and the LIF model can segment well image, while giving bad 
segmentation results for other initial contours. Otherwise, the proposed model is much more robust to initial 
contour location and can achieve good segmentation results for all initial contours. 

To quantitatively validate the segmentation performance of the proposed model from Figure 3, 
the Jaccard Similarity (JS) index is used. The JS index between the segmented object region Rs and the real 


JS(R_,R_)=|R. ORol/| RsU Rol a 
object region Ro is calculated as sO s . Clearly, when Rs is more similar to 


Ro, the JS value is close to 1. Figure 5 shows that the JS values obtained by our method change in a small 
range for intensity inhomogeneity with different strength, while the LBF model and the LIF model, when the 
strength of intensity inhomogeneity is strong in last two rows of Figure 3 the segmentation accuracy of this 
method decreases strictly. These results illustrate the robustness of the proposed model to image 
intensity inhomogeneity. 

In Figure 6, we apply the proposed model to segment typical remote sensing images with different 
modalities and compare it to CV, LBF and LIF models. The first row shows the four input images with red 
initial contour, whereas the segmentation results are shown using CV in the second row, LBF in the third 
row, LIF in the forth row and the proposed method in the last row, respectively. In the second row, it can be 
seen that the CV model fails in all given images because it’s based on global properties of image. Although 
the other methods are based on the local properties of the image, they don’t lead to a good segmentation. 
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Moreover, the LBF and the LIF models fail to distinguish between the intensity between the object and its 
background and lead to inaccurate segmentation results. But our method results are more satisfactory as it 
shown by green circle in the first row. So, it can segment more detailed regions than the other methods as 
shown by the green arrows. These results represent the abilities of the proposed model to deal with intensity 
inhomogeneity and complex background. 

Figure 7 shows some segmentation results by applying the proposed method to differentintensity 
inhomogeneous noisy images. Although noise affected the crispness of edges in theinput data, the proposed 
method is able to yield acceptable segmentation results. 


as 
SS 








-~ ae 


Figure 3. Segmentation results on a synthetic image where the strength of intensity inhomogeneity is 
gradually increased from left to right. Row1: input images with the initial contour. Row2: results of the CV 
model. Row3: results of the LBF model. Row4: results of the LIF model. Row5S: results of 
the proposed model 
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Figure 4. Effect of position of initial contour on the final segmentation results 
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Figure 5. The corresponding JS values yielded by the LBF model, the LIF model and the proposed model on 
the five images with different intensity inhomogeneity 





Figure 6. Segmentation results on remote sensing images. Row1: input images with red initial contour. 
Row2: results of the CV model. Row3: results of the LBF model Row4: results of the LIF model. Row5S: 
results of the proposed model 


First row original image added the salt and pepper noise with initial contour, second row final 
contour. Furthermore, the iterations and CPU time of segmenting the images in Figure 6 are listed in Table 3 
for all models studied in this paper. The proposed method yields the lowest time complexity for the examples 
shown in rows 4 and 5. It takes 23.72 and 29.54 seconds for the examples shown in the last two rows, 
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respectively. On the other hand, CV and LBF have the lowest time complexity for the example shown in row 
2 and 3. In row 2, they take 30.54 and 105.95 seconds respectively while the proposed method take 441.68 
seconds to obtain the final contour. Similarly for row3, they take 27.65 and 52.27 seconds respectively while 
the proposed method take 96.06 seconds to obtain the final contour. Although CV and LBF have the lowest 
time complexity for this example, it 1s unable to properly segment the object as shown in Figure 6. 
Accordingly, the proposed model 1s much faster than the othermodels. 











» 
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Figure 7. Segmentation results on a different intensity inhomogeneous noisy images 





Table 3. Iterations and CPU Time for the Examples Shown in Figure 6 
Row2 Row3 Row4 Row5 
Models Iterations CPUtime(s) Iterations CPUtime(s) Iterations CPUtime(s) iterations CPU time(s) 


CV 800 30.54 900 27.65 900 29.67 1500 65.53 

LBF 600 105.95 400 52.27 100 49.98 400 502.46 

LIF 400 520.2] 200 315.46 150 45.13 500 560.51 
Our model 400 441.68 100 96.06 50 23.12 50 29.54 


Active contour methods behave differently for different types of images. Because the synthetic 
images shown in Figure 3 have different characteristics compared to Satellitales images shown in Figure 6. 
The parameters used for all experiments in Figure 6 are shown in Table 4. For example, as shown in Table 4, 
the parameters are fixed at “=5 and “=1. So, “is higher than” because when the intensity inhomogeneity is 
severe like the images presented in Figure 6, the accuracy of segmentation relies on the local SPF, in such 
case, we choose a small ”2; the local SPF becomes degenerating the global SPF so that the contour is attracted 
to the object boundary quickly. Similarly for the parameter ° , it is advisable to choose a small? to segment 
the small object in further detail (in this case ° =3). The parameters had to be tuned in order to obtain the best 
possible segmentationresults. 


Table 4. Parameters for the Experiments Needed when Segmenting Images in Figure 6 


i 2 7 bBo GC Y p é& MT 

CV 1 1 0.2 0 - 1 1 0.1 

LBF 1 1 0.001 - 4 - 1 15 Ol 
LIF : - - 3 1 2 1.5 1 

Our model 5 | 1 0.25 3 0.5 1 15 0.1 


5. CONCLUSION 

We have presented a new ACM which is able to use globaland local image property for segmenting 
a range of images with intensity inhomogeneity. The main contribution of this paper is to expand the LIF 
model which is includes only local image information to a local and global in the variational level set 
formulation. We have also introduced the SPF function in the gradient descent solution to give more 
robustness to the final solution and extract multiple objects with several intensities. The tests results have 
shown that our method performs robustly in severe inhomogeneity and is effective as well as less sensitivity 
to the initial contour location and less time compared with the related works. In future we aim to extend it to 
multi-phase segmentation and we hope to reduce the computing time consuming. 
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